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APPLICATION  OF  LEAST-SQUARES  ALGORITHMS  TO  ADAPTIVE  ECHO  CANCELLATION* 

* 

V.  U.  Reddy, F.  K.  Soong.A.  M.  Peterson  and  T.  K ai lath 


SUMMARY 


With  the  advent  of  commercial  communication  satellites,  rcundtrip 
delays  of  the  order  of  500  ms  in  long  distance  telephone  conversations 
have  become  quite  common.  Use  of  echo  suppressors  on  such  long  distance 
telephone  circuits  has  not  given  satisfactory  performance  and  hence  atten¬ 
tion  has  been  directed  to  the  use  of  adaptive  echo  cancellation[l,2] . 

Essentially  all  the  significant  echoes  are  generated  at  the  hybrid 
transformer,  which  acts  as  a  two-wire/four-wire  interface  in  a  long  distance 
telephone  circuit.  It  is  the  impedance  mismatches  introduced  by  the  hybrid 
transformer  that  cause  echoes.  Thus  the  echo  signal  is  a  delayed  and  trans¬ 
formed  version  of  the  speech  signal.  If  an  adaptive  filter,  implanted  using 
an  adaptive  algorithm,  can  simulate  the  transformation  yielding  the  erho, 
the  echo  can  be  eliminated  by  subtracting  the  simulated  echo  from  the 
actual  echo  signal.  The  combination  of  the  adaptive  filter  and  the  subtrac¬ 
tor  is  known  as  an  adaptive  echo  canceler.  Since  perfect  cancellation  is 
only  possible  asymptotically,  it  is  important  to  know  how  fast  the  residual 
echo  power  falls.  This  depends  on  the  convergence  properties  of  the  adaptive 
algorithm.  The  algorithms  that  have  been  extensively  studied  so  far  in  the 
context  of  echo  cancellation  are  all  based  on  stochastic  gradient  approxi¬ 
mations^, 2, 3].  Only  recently  have  fast  Kalman  estimation  algorithms  and 
lattice  algorithms  been  applied  to  adaptive  channel  equal ization[4,5].  The 
echo-killer  chip  recently  developed  by  Bell  Telephone  Laboratories^]  uses 
the  so-called  least-mean-squares (IMS)  algorithm  for  adaptation.  One  good 
feature  of  this  algorithm  is  its  simplicity. 

+This  work  was  supported  in  part  by  uhe  Joint  Services  Electronics  Program 
at  Stanford  under  Contract  DAAG29-81-C-0057 ,  by  the  National  Science  Found¬ 
ation  under  Grant  ENG78-10003 ,by  the  U.S.Arniy  Research  Office  under  Contract 
DAAG29-79-C-0215,and  by  the  Air  Force  Office  of  Scientific  Research,  Air 
Force  Systems  Command,  under  Contract  |F49-620-79-0058,and  by  Granger 
Associates  Contract  2. 
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Under  the  conditions  of  one-way  speech,  i.e.,  when  only  one  speaker 
is  talking,  it  would  suffice  if  the  canceled  ->H?ots  to  the  unknown  echo 
path  as  quickly  as  possible  and  continue-  .u.  .-"'all  variations  in 

the  echo  path.  However,  in  normal  telepho-  *  ,*rs,-*-'.ns  there  are  many 

intervals  during  which  double-talking, i .e. ,  tv*  s  ^Ik  simultaneously, 

takes  place.  During  such  periods,  the  second  "pc  speech  acts  as  a 

gigantic  additive  noise  for  the  echo  cancel  .  whi  .rying  to  cancel 

the  echoes  of  the  first  speaker.  This  forces  the  adapted  path  to  diverge 
from  its  previously  adapted  values.  This  has  two  effects:  i)  The  cancel er 
performs  very  poorly  during  the  double-talking  intervals  and  ii)  the  can- 
celer  needs  to  re-adapt  to  the  unknown  echo  path  after  the  second  speaker 
stops  talking.  Hence,  it  would  be  highly  desirable  to  have  an  algorithm 
that  not  only  has  fast  convergence  but  also  stops  the  adapted  path  from 
diverging  during  the  double-talking  interval.  This  paper  contains  the  res¬ 
ults  of  a  study  with  the  above  objectives. 

Two  different  structures  are  considered  for  the  echo  canceler.  One 
uses  the  usual  tapped-delay-li  ie(TDL)  filter  arid  the  other  is  based  on 
the  lattice  configuration.  The  TDL  canceler  was  simulated  using  two 
different  adaptive  algorithms:  i)  LMS(a  stochastic  gradient  version)  and 
ii)  recursive  least-squares(RLS) .  The  lattice-form  canceler  was  simulated 
using  the  corresponding  exact  least-squares  algorithm.  A  typical  hybrid 
transformer,  which  forms  the  unknown  echo  path,  and  the  two  test  speakers  ' 
signals  were  simulated  on  the  lines  suggested  in  the  standard  CCITT 
report[7].  Fig.  1  shows  the  impulse  response  of  the  hybrid  transformer. 

A  TDL  echo  canceler  shown  in  Fig. 2,  where  xt  is  the  far-end  speech 
signal  (first  speaker's  signal),  y^.  is  its  echo  and,  vt  is  the  sum  of  the 

near-end  speech  signal (second  speaker's  signal)  and  the  white  noise  n. 

T  ^ 

(system  noise).  The  RLS  update  of  the  coefficient  vector  A  =(a0,  a^,... 


a^)  is  given  by 
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echo  canceler  and  the  ->rresponding  least-squares  lattice  (LSLAT)  algori¬ 
thm,  see[8]. 

Figures  3a  and  3b  illustrate  the  convergence  behavior  of  the  31-tap 
TDL  and  lattice-form  echo  cancelers,  respectively.  The  plots  show  that 
the  RLS  and  LSLAT  algorithms  converge  in  about  100  iterations  and  the 
residual  error  power  at  convergence  is  practically  equal  to  -40  dB 
which  is  the  power  of  the  system  noise  n^.  The  plots  also  show  that  the 
RLS  and  LSLAT  algorithms  behave  identically  after  a  small  number  of  iter¬ 
ations,  say  50.  The  difference  during  the  initial  period  is  due  to  the 
different  initial  conditions  assumed  in  the  two  algorithms. 

For  the  purpose  of  illustration,  the  TDL  canceler  was  also  simulated 
using  the  LMS  algorithm.  The  constants  of  the  algorithm  were  adjusted  to 
give  the  best  possible  performance.  Figure  4  gives  the  learning  curve. 

The  results  show  that  the  LMS  algorithm  gives  a  residual  error  power  that, 
even  after  800  iterations,  essentially  converges  to  a  level  about  6  dB 


above  the  system  noise  level. 

To  overcome  the  double-talking(two-way  speech)  problem,  a  modifica¬ 
tion  of  the  RLS  algorithm  is  proposed.  The  modified  algorithm  is  given  by 


At  =  At-1 


Pt  =  Pt-1 
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where 


gt  =  Var(nt)/  Var(vt)  (5) 

(For  the  corresponding  modified  LSLAT  algorithm  ,  see[8]). 

During  the  double-talking  intervall/gt  assumes  a  large  value,  i.e., 
of  the  order  of  10.  This  forces  the  second  term  in  (3)  and  (4)  to  be 
very  small.  How  small  these  terms  become  depends  on  the  relative  values 
of  Pt  and  Pj.  j.  It  is  known  that  P^  tends  to  zero  at  the  rate  nf  1/t. 
Since  there  is  always  a  time  lag  between  the  starting  of  the  conversation 


(at  which  time  the  adaptive  algorithm  begins)  and  the  initial  double-talking; 
the  term  xJpt_jXt  is  effectively  negligible  compared  to  1/g t  at  the  instant 
the  double-talking  starts.  Tons,  the  modified  algorithm  of  (3)  and  (4) 
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virtually  freezes  P't<  and  at  the  instant  the  double-talking  begins  and 
continues  to  do  so  for  the  whole  double-talking  interval. 

To  verify  the  performance  of  the  modified  algorithm,  an  echo  path 
consisting  of  a  flat  delay  of  20  samples  in  cascade  with  the  hybrid 
transformer,  giving  an  impulse  response  that  is  a  20-sample  delayed  vers¬ 
ion  of  the  one  shown  in  F'g.l,  and  a  51-tap  adaptive  filter  were  chosen 
for  the  simulation.  Only  the  lattice-form  canceler  was  used  in  the  experi¬ 
ment.  The  normal  LSLAT  algorithm  was  run  initially.  The  modified  version 
was  started  at  401-th  iteration  and  the  second  speaker^  signal  was  started 
at  501-th  iteration.  The  algorithm  was  run  for  a  total  number  of  1000 
iterations  and  the  impulse  response  of  the  adapted  path  was  computed  from 
the  filter  parameters  at  1000-th  iteration.  In  the  un-modified  case,  the 
normal  algorithm  was  run  for  1000  iterations. 

Figures  5a  and  5b  show  the  impulse  response  of  the  adapted  path  with¬ 
out  and  with  modification.  Comparing  these  results  with  Fig.l,  it  is  clear 
that  the  modified  algorithm  leaves  the  adapted  path  almost  unaffected  by 
the  double-talking.  On  the  other  hand,  the  adapted  path  is  severly  distorted 
by  the  double-talking  when  the  modification  is  not  used. 
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Fig.  4  Convergence  behavior  of  the  LMS  algorithm 


